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(54) Method and system for restoring a distributed telecommunications network 



(57) This invention indudes a path-based method 
and system that restore a distributed telecommunica- 
tions network (90) from a failure condition (92). First the 
method and system notify all the network nodes (22, 24, 
26. 28) Of the fault of a link (12). Next, an alternate route 
finding phase occurs for finding alternate paths (S-TI- 
T4-D) to reroute the disrupted traffic. For finding alter- 
nate paths (S-T1-T4-D), the alternate route finding 
phase includes sendng messages (70. 100) throughout 
the distributed telecommunications network. Upon find- 
ing some alternate paths (S-T1-T4-D), the method and 
system send connect commands (100) to make the 
necessary cross connections In the distributed telecom- 
munications network nodes (22. 24, 26. 28) that are on 
the alternate paths (S-T1-T4-D) Throughout the distrib- 
uted network restoration process, the method and sys- 
tem synchronize (^) the distributed telecommuni- 
cations network rwxles to avoid possible race conditions 
among the nodes. 
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Description , 

TECHNICAL FIELD OF THE IMVFNTIOM 

[0001] The present Invention relates to telecommuni- 
cations methods and systems that include distributed 
network cross connects and. more particularly, to a 
method and system lor restoring a distributed telecom- 
munications network and. even more particularly, to a 
method and system that allows cooperating digital cro^s 
connect switches to reroute traffic from one path to 
another when a link or a node in an original path fails. 

BACKGRQUND OF THE INVENTIOM 

[0002] With the widespread deployment of fiber optic 
transmission systems and the alarming rate of outages 
due to fiber cuts, there is great interest in improving the 
process Of restoring disrupted traffic from minutes to 
sub-seconds following a ftoer or span cut. Automatic 
protection switching probably is the fastest technique 
and can switch the disrupted traffic to dedicated spare 
links in under 50 milliseconds. However, it also requires 
high dedicated spare channel capacity. .With recent 
advances in digital: cross connect systems (DCS), there 
is increasing interest in using. DCS in network restora- 
tion, : ■ ) ..J . . - 
[0003] There are two basic approaches to reroute the 
disrupted traffic due to a fiber span cut*The link restora- 
tion approach replaces the affected link segment of a 
disrupted channel by a spare path between the two dis- 
rupted ends. The path restoration approach releases 
each disrupted channel and lets the, source and desti- 
nation end of the channel re-establish the connection. 
With the additionaLrelease phase the path restoration 
approach, takes more time than the link restoration. 
However, the path restoration approach can find more 
efficient spare paths with fewer link segments and can 
handle the node failure situation with the same logic. 
The link restoration ' approach has applications in 
achieving fast network restoraition.. * ' 
[0004] A well-known distributed network restoratton 
method for a DCS-based fiber network was proposed by 
W. D, Grover in The Setf-Healing Network A Fast Dis- 
tributed Restoration Technique For Networks Using Dig- 
itar Cross-Connect Machines". Proa GLOBECOM '87, 
pp. 28.2.1-28.2.6. 1987 and detailed in his 1989 Ph.D. 
dissertation for the Department of Electrical Engineer- 
ing at University of Alberta entitled. "Self Healing Net- 
works: A Distributed Algorithm For K-Shortest Link- 
Disjoint Paths In A Multi-Graph -With* Applications In 
Real Time Network Restoration." The protocol associ- 
ated with that process is called the Self-Healing- Net- 
work (SHN) protocol: 

[0005J Another distributed network restoration proc- 
ess for DCS-based fiber networks has been proposed 
by Yang and Hasegawa in "FITNESS: Failure Immuni- 
zation Technology for Network Sun^ivability," Prpc. of 



GLOBEQOM '88. pp. 47.3.J-47,3.6, Nov. 1988, This 
method . became known as Bellcore's FITfsiESS 
approach. - , . 

[0006] . RREACT is another distributed approach to 
5 network restoration and is described in detail in "RRE- 
ACT: A Distributed Protocol for Rapid Restoration of 
Active Communication TrunksV, UCCS Tech Report 
EAS-CS-92-1 8, Nov. 1 992. 

[0007] . The^ above approaches are not sufficient as 
10 they appear to be unstable and result in an epcplosion of 
messages throughout the network following" the failure 
of a network. link or node. These^ approaches also rely 
upon extensive knowledge of the network topology prior 
to the failure. Unfortunately, the information could be out 
15 of date at the time of the failure, espedally in the situa- 
tion of a multiple link failure. The complexity, instability, 
and unreliability make these approaches unsatisfactory 
for many types of distributed telecommunications net- 
works. . . ' . 
20 . . . - , ! / 
SUMMARY OF THE INVENTION \, " ' , 

[0OO8] In light of the above limitations, there is a need 
for a method and system to allow cooperating digital 
2S cross connect switches to reroute disrupted traffic from 
one path to another when a link or a node in the original 
path;fails^y:q - . . ; 

[0009] A need also exists for a method and system for 
cross connects of a distributed telecommunications net- 
so work to explore, the network topology, determine an 
.alternate, path through the network to restore traffic 
around alail^ link or node, and to restore the failed 
traffic to a new path. 

[0010] ; In accordance with the present invention, a. 
. 35 ' method, and system for restoring a distributed telecom- 
munications network is provided that sujDStantially elim- 
Jnates or reduces disadvantages/ and .prpblems 
associated with previously developed network restora- 
tion or recovery method? and system. 

40 [001 1 ] In one aspect of the present invention, a distrib- 
uted telecommunications network restoration process is 
provided that includes a step of detecting the failure of a 
link and notifying at least all neighbfortng network nodes 
of the fautt.,Next, the alternate route finding phase finds 

45 alternate paths to reroute the disrupted telecommunica- 
tions network traffic. . This step involves sending mes- 
sages throughout the network to find possible alternate 
paths. Once the process finds some alterriate paths, the 
present invention issues to make the necessary cross 

50 connections in the nodes that , are on the alternate 
paths. To avoid race conditions during the process, the 
present invention synchronizes the distributed telecom- 
' munications network nodes; This^feature includes pass- 
ing messages between the network node$ to controlled 

55 message exchanges occurring between the . nodes. 
However., the process only generates one message for 
each group, of failed paths between the "controlling" 
nodes, rather than one message per path. 
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[001 2] A technical advantage of the present invention 
Is that it operates significantly faster and restores traffic 
in a given distributed telecommunications network more 
completely than do other message flooding or other 
types of traffic restoration or recovery processes. 5 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 3J For a more* complete understanding of the 
present invention and the sidvantages thereof, reference to 
Is now made to ttie foliowing-description which is 'to be 
taken in conjunction with the accb'npanying dravwngs in 
which like reference numerals indicate like features and 
wherein: 

■ FIGURE 1 illustrates the meaning of and' contexts 
^of selected terms relating to'the present invention; 

- ^ FIGURE 2 provides the fornriat of a failure message 
that the present invention may use: 
FIGURE 3 d^icls the failure of a distributed tele- 20 
communications 'network span between tartdem 
nodes, T1 and T2, for which the present invention 
' creates multiple source destination pairs, S1-D1 

. 'ahdS2-D2: ■ ' 

FIGURES 4 and 5 show a three-ribde. network 25 
desCTibihg'the message exchanges* occun-ing dur- 
ing the synchronising steps of the pres6rrt' ihven- 
^ tion;^ ■ ' . ' ' 

FIGURE 6 provides the'format of an explore mes- 
sage that the present invention nrtdy use; '- ^' • 30 
FIGURE 7 is a'conc^tual illustrafieffi^'of a*source 
node! S. sending explore messiagesib^neighboring 
tandem nodes, T1 and T2; - ^* • 

FIGURES 8 and 9 'describe actions taken by tan- 
dem nddes, Tl through T4, upon receiving* an 35 
explore message; ' '] ' ' 

■ FIGURE 10 provides the forrnat of the return mes- 
sage that the present invention may use; ■ • 
FIGURE 11 shows conceptually the actions taken 

■ by a destination node, p, in generating a restore 40 
message after receiving an explore message; ' "■> 
FIGURE 12 depicts how the present invention han- 
dles contentions for spare capacity throughout a 
distributed telecommunications netwak; . 

FIGURE 13 describes actions taken by tandem 4S 
^ diodes, T1 tiirough T4. upon receiving a return mes- 
sage; ' ■ ' • * ' - 
FIGURE 14 shows a last step of the return phase of 
" 'the present invention; 

' FIGURE 15 illustrates the subnetwitork that a source - so 
node. S, may coriistruct in performing the process of 

■ the present invention; ■ ' ' ^ 
FIGURE 16 shows alternate routes that the present 
invention may select In executing a maximum flow 
process: . ; 55 

FIGURE 17 provides the format of a' connect mes- 
• sage that the present invention may use to estab- 
lish alternate paths for the disrupted traffic; 



FIGURE 18 provides the connect message for the 
alternate route (S-T1-T4-D) with a predetermined 
capacity; and 

FIGURE 19 provides the format for the path 
• restored'message upon conipleting the restoration 
process of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION . 

[0014] Prefen-ed embodiments of the present inven- 
tion are Illustrated In the FIGURES like numerals being 
used to refer to, like and corresponding parts of the var- 
ious drawings. 

[0015] FIGURE 1 illustrates an example of a disUib- 
uted telecommunications network 10 for defining terms 
relating to the present invention. In FIGURE "1 , the tele- 
communications network is generally labelled with refer- 
ence numeral '10 and includes link 12 is a connection 
that supports bi-dif ectional signal, such as that of a DS3 
system existing between two adjacent nodes. Span 14 
represents a set of all. links between two- adjacent 
nodes. Patii 16 describes a series of links of a given dis- 
ti^ibuted telecommunications network. A route is a set of 
paths 10 that go through the same sequence of nodes, 
such as paths 16, 18 and 20. A source node 22 provides 
a label for the. end node of a failed path with a smaller 
node identifier tiian the other end nodes of the failed 

■ path. Adestination node 24 may refer to the end node of 
a failed patii witii^a larger node identifier than tiie.other 
end nodes. TandeJm nodes 26 and 28 are nodes that are 
neitiier a sour^et node 22 nor a destination node 24 for 
a failed path. The term "hop count sequence" defines a . 

■ sequence tiiat specifies the hop count limit for each iter-, 
ation of the process of the.present invention. • ^iiir 
[0016] The present invention provides a process tiiiatt 

' a confrol system for a distributed telecommunications 
network may employ for restoring communication 
between nodes that terminate In a failed link. 
[0017] Distributed telecommunications network ,10 
may be a high-speed transport system, such; as the 
Synchronous Optical Network (SONET) prescribed by 
American National Standard, ANSI T1. 105-1 988, "Dig- 
ital Hierarchy Optical- Interface Rates and Formats 
Specification," 10 March 1988. Such a network may 
normally be a filler optic arrangement comprising 
Ixoadband digital cross connect systems that connect 
network links at the STS-1 level (Synchronous Trans- 
port.Signal level 1, 51.84M bit/s). Since the network will 
frequentiy be used in applications, such as broadband 
ISDN applications, requiring multiple STS-1 bands, it is 
of particular technical advantage that the present inven- . 
tion includes the process and the system for implement- 
ing the process of locating and restoring a 
telecommunications patii, having the maximum ti^ffic 
flow to tiiereby economically restore disrupted service. 
[0018] The present invention uses Information tiiat 
distributed telecommunications network 10 knows at 
the time of a node failure or link failure. The knowledge 
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that distributed telecommunications network 10 knpws 
relating to. each node before a failure includes the node 
identifier and type of each node (e.g.. working, spare, or 
access/egress nodes). Distributed telecommunications 
network 10 also loiqws which is the far end or destina- 5 
tion node identif ier of each path. Distributed teiecommu- 
nications, network 10 holds this information in a "keep 
alive message," The tfestihation node identifier of each 
apcess/egress port, is also known by the network. ; 
[001 9] Restoring distributed telecommunications het- 10 
work 10 following a failure using the process of the " 
invention may make use of, for exanple, embedded 
SONET overhead channels to conveniently provide the 
communication of the below-described messages. 
.Usin^ .these messages, the present, invention permits is 
exrfianges between nodes to guide the necessary alter- 
nate path or paths between the source nodes 22 and 
destination nodes 24 to restore the disrupted telecom- 
munications, traffic. 

[0020] The failure between a source node 22 and a so 
destination node 24 may be due to a span cut. for exam- 
ple. Once the two end nodes of a failed route 1 6, 1 8. 20 
detect a failure, the node with smallest node identifier 
assumes the role of source node 22 and the node with 
the largest node identifier becomes destination node ss 
24. Source node 22 and destination node 24 then send 
a failure message to all of .their neighbors. 
[0021] FIGURE 2 provides the format of.a failure mes- 
.sage 30. On receiving failure message 30, a tandem 
riode fonvards the message to all of its neighboring 30 
nodes except for the neighboring node'which sent the 
failure message 30. After receiving failure message 30, 
the source node 22 initiates the, next process of the 
present invention. . • . , - 
[0022] With the present invention, a node may receive 35 
several failure messages 30 refating to,a particular 
source node-destination node pair. The receiving node 
towards only the first;failure message 30 it receives and 
. ignores others coming aftenvard. If the node receives a 
failure message 30 for some other source nodendestina- 40 
tion node pair, the node fonvartis the failure message 30 
that It first received to the later-transmitting source-des- 
tination pair. . 

[0023] Note that with the present invention, there may 
be more than one source node-destination, node pair 45 
due to a single span cut. FIGURE 3 shows this possible 
. situation for network pcrtion 38. In FIGURE 3. source 
nodes, SI and S2. feed to fandem node 40 via paths 42 
and 44, respertively. Span 46 connects tandem node 40 
to fandem node 48; Tandem node 48 connects via paths so 
50 and 52 to destination nodes, Dl and D2. respec- 
tively. Span cut 54 represents a failure in span 46 
between tandem nodes 40 and 48. Each node keeps a 
count of the number of source- node<Jestinatfon node 
pairs based on the distinct failure messages 30 which ss 
the node has received. This failure message 36 count is 
useful to later, terminate the process of the present 
invention. 



[0024] The procesfs of the present invention uses 
nodes that are .loosely synchronized." Synchronizing 
the nodes prevents' race conditions and helps each 
node to determine the termination of each phase of the 
process. Each node maintains , a step counter. The 
nodes use a special m^sage. a step completed mes- 
sage, for synchronization. Tlie step completed mes- 
sage may contain only a type field which indicates that 
it is a step completed message.^ ' ' 
[0025] FIGURE 4.and 5 aid in' understanding the syn- 
chronization process of the present invention; FIGURES 
4 and 5 include network portion 60 and lines 62 that cor- 
respond to nodes A, B, and C, as well as dashkl-lihe 
step completed message 66 and solid-line restoration 
message's 68. During a step, a node may need to per- 
form some action. The.actibn that a nodejs to perform 
may be to process the restoration messages SB it previ- 
ously received during the previous step and forward the 
restoration rnessages 68 to . its' neighbora. Once the 
node performs all the actions for current step, the node 
then sends a step completed riiessage 68' to each of its 
neighbors. ^ ^ 

[0026] If the node receiyes'any restoration messages 
^8 frorn^ any neighboring nodes, the node stores the 
messages to process therrr during the next step. The 
nocie then yvfits for step completed messages .from all 
of .its neifltifaqrs. After receiving step completed mes- 
sages §6, ffpm all neighboring nodeis. liie node incre- 
, nrients the step counter to proceed to tfie next step. The 
al)ove rule^ keep the nodes loosely synchronized^ Note 
^ that a node >wll not proceed to the; heitf step uril ess all 
neighboring^^ribdes are "ready to proceed to the n6xt 

/Step.^ . ; * 

[002^ Focusing more on FIGURES ikrid 5', consider 
network portion 60 which includes nodes A, B. and C 
Unes 62 irjclMde line A that corresponds to node A. line 
B that coaesponds to node B. and line C that corre- 
sponds to node C. Span cut 64 depicts a span cut 
-between node A and node C. 
[0028] > node begins the synchronizing proc^ of the 
present invention once.the riode learns about a failure. 
The initial value of step counter is 0. A node resets its 
associated step counter to 0 when theVestoration proc- 
ess terminates. Node A. therefore, may be labeled a 
source node 22. and node C may be labeled a destina- 
tion node 24. Each node starts synchronizing once it 
receives, a failure message (see FIGURE 6). Restora- 
tion will be ihitlated by source node A by sending resto- 
ration messages 68. Destination node C has no 
restoration message 68 to send, so it just sends a step 
completed message 66 (a synchronizatfon message) to 
tandem node ? (its only neighbor) and waits for a step 
completed message 66, from taridem node B. 
[0029] Tandem node B has no restoration. message 68 
to send, so itjust sends step completed message 66 to 
both neighboring nodes A and G. After receiving a step 
completed message from tandem node B. destination 
node C proceeds to its next slep. Tandem node B does 
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not proceed to its next step since it has not received a 
step completed message 66 from source node A. 
[0030] Since^source node A is a source node, it initi- 
ate the restoration by sending a restoration message 
68 to tandem node B and then It sends a step conv 5* 
pleted message, as FIGURE 5 irdicates. Tandem node 
B proceeds to the next step once it receives a st^ com- 
pleted message 66 from riode_A. Tandem node B will 
process the restoration niessage.68 in Step 2. Those 
types of synchronizing steps continue throughout the io 
process of the present Invention.' An Inrtpdrtant property 
of the synchronization steps of the present invention, 
therefore, is that a restoration message 68 takes one 
step to travel one hop. A next phase of the method of the 
present invention involves finding an alternate route for is 
the disrupited telecommunications traffic'. This phase 
proceeds, in iterations. In each iter^ion. the present 
invention finds alternate routes of a sjp'ecified hop count 
limit between each source node 22 and the correspond- 
' ing destir^ation node! At the end of an iteratibn, if there 20 
is a source node 22 and destination node between 
which the present invention has not fully restored traffic, 
the process, continues to the next iteration with an 
increased hop count limit. Othenwise the process termi- 
nates, . ' . . . ^ 
,[00311, ' An Iteration consists of three phases: (1) an 
explore (Dhsise. (2) a return phase. (3) a^rfi^mum 
process e?cec,ution phase. In the explores phas^, the 
, present invention sends explore messages (FIGURE 6) 
from source nodes 22 and.fonwarded by tandemVicides so 
"26 to explore the availability of the alterriate spare 
rout^es. An &ap\ore phase, therefore, is initiated by ttie 
source nodes 22. The return phase is initiated by desti- 
■ nation nodes 24 which send return messages (FIGURE 
.10) in response to the 'explore messages received^ by 3S 
' them. A return nhes^age traverses the route traversed 
by its ck)rresponding explore message in the reverse 
direction. The return messages confirm liie availability 
of spare routes. At the end of return phase a source 
^ node 22 constructs a model of a subnetwork' with spare 40 
' capacities-ljased on thiB infornrlation from the return 
messages it received-ahd then executes a maximum 
flow process to find alternate routes providing the maxi- 
mum flow for the communications traffic. 
[0032] f=or every iteratibn. there is a corresponding 45 
' hop count limit The hop count limit specifies the 
' number of hops the explore messageis wiD travel in 
exp)6re,phase. Let -h* be the hop count limit for the cur- 
rent iteration, for example. Then the explore messages 
travels at most "h" hofis in this rteration. Since each res- ' so 
toration message ^takes- one step to travel a hop, the 
explore phase of 'this Iteration takes "h" steps. The 
return phase also takes "h* steps. 
' [0033] Source nodes 22 initiate the explore phase of 
the present invention. The explore phase of the first iter- ss 
ation begins immediately after a node learns about a • 
failure. Ea6h node knows exactly when'the subsequent 
explore phases begins using the above-desaibed syn- 



chronization steps. 

[0034] FIGURE 6 provides the format of an explore 
message 70. Explore message 70 indudes "msg type" 
field 72 to indicate that the message is an explore mes- 
,sage.* "Source node id* field 74 contains the identifier for 
source node of the disrupted route. "Destination node 
id" field 76 contains tiie disrujated route's destination 
node identifier. "Capacity" field 78 specifies the capacity 
of ass's, for example, that the alternate route requires. 
Information in "hop count" field 80 is filled by source 
node 22 to record the hop count limit of the current iter- 
ation. A source node 22 creates an explore message 70 
and sends it on each span 46 having has some spare 
capacity . * 

[0035] FIGURE 7 helps to explain how the present 
, invention operates by conceptually illustrating a distrib- 
uted telecommunication network 90 that Includes a 
source node, S, sending ebcplore message 70 to neigh- 
boring tandem nodes T1 and T2. The traffic (100 units) 
between source node, S, and destination node, D, is 
disrupted due to span cut 92. During Step 1 (/.e. the first 
Iteration) source node, S, forms an explore message 70 ' ^ 
and sends it to both neighboring tandem nodes, T1 and 
T2. Note that the "msg typje" field 72 Is not shown in the 
explore messages 70' of FIGURES 7 through 9, for sirh- 
plicity. During Step/l. all other nodes do not send any 
restoration messages: These nodes will send step com- 
pleted messages' to tiieir neighbors, but these are also 
not shown in FIGURE 7 for the sake of simplicity. After 
sending th6 explore messages 70, source node; S, ^ 
sends a step conpleted message to its neighboring tan- ^ 
dem nodes, T1 -and T2^ * " ' 

'[0036] A node on receiving an* explore message 70 ' 
compares its own node identifier with the "destination- ;^ 
id" field 76 contents off tiie explore message 70. If thesr^^ 
identifier values do not match, then tiie receiving and 
comparing node determines itself to be a tandem npde. 
[0037] In general, the role of a tandem node 26 during 
an explore phase is to receive an explore message 70, 
decrement "hop count" field 80, and then fonward the 
explore message 70 to all neightx)rlng nodes other than 
the neighboring node that sent this message. However, 
the explore message 70 may not be fonwarded if either 
of the following holds: (1) the hop count of tiie incoming 
explore message 70 is 1 , or (2) tiie explore message 70 
' received is not the first explore message 70 received for 
a particular source node-destination node pair. In this 
case, the' explore message 70 is stored and used during 
tiie return phase. 

[0038] FIGURES 8 and 9, respectively, describe Steps 
2 arid 3 which tandem nodes, T1 through T4. take after 
receiving an explore message 70. • Considering the 
example shown in FIGURE 7. tandem nodes. T1 and 
T2, teceiye.tiie explore messages 70 tiiat the source 
node, S. sends. Tandem node T1 forwards the explore 
message 70 to tandem node T4, after decrementing the 
"hop count" field 80 value of tiie received explore mes- 
sage 70. Similarly, tandem node, T2, fonwards the 
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explore message. 70 to its neighboring tandem nodes 
T3andT4, . . ... " * 

[0039] During Step 2 of FIGURE 8, tandem node. T4, 
receives two explore messages 70 for the source node- 
destination node pair, S-D. Tandem node. T4. then for- 
wards only one of them in Step 3. which FIGURE 9 
describes.. ; : 

[0040] A node determines that it is a destination node 
24 for an explore message 70 by comparing Its node 
identifier with the "destination id" field value of the 
explore message 70. If there is a match, then the node 
that matches is the destination node 24 .for this, mes- 
sage. A. destination, node 24 simply stores all -the 
explore messages 70 it receives. The destination node 
responds to the explore messages 70 during the return 
phase by sending retum messages back' through the 
tandem nodes 26 to the source nodes 22.. • 
[0041] The.destination node 24 initiates the return 
phase of the process of the. present invention. The 
return phase starts "h" steps after the beginning of the 
Iteration, where. "h" is the hop cpunt limit for the current 
iteration. Since each node knows which step it is based 
on the hop count, the destination node 24 can begin the 
return phase during the "h+1 step of the cun-ent itera- 
tion. 

[0042] . For each explore message .70 received, a des- 
tination node 24 sends a/eturn message to the neigh- 
bor who sent the explore message. FIGURE 10 
provides the format of returri message 100. The "msg 
type" field 72. "source id" field 74. and>destination id" 
field 76 function -as described above. The "spare route 
info" field 1 02 of return message 1 00 contains the topo- 
logical information about a spare route from the source 
to destination and about the spare, capacity available on 
the spare route. The tandem nodes. T1 through T4. 
append Information to the "spare route info" field 102. A 
destination node 24 creates a return message 100 for 
each explore message 70 it previously received during 
the explore phase. The destination fills "spare route 
info" field 102 with the destination node 24 identifier 
The destination node 24 then sends the return message 
100 to the neighboring node which previously sent the 
corresponding explore message 70. 
[0043J Referring now to FIGURE 1 1 . and continuing 
with the example of FIGURE 9. the return phase begins 
in Step 4 which includes the response of the destination 
node. D. to the explore messages 70 it previously 
received. In the return phase, a tandem node 26 
receives a retum message 100 on a span only if it had 
' sent a coaesponding explore message 70 on that span 
dunng the explore phase. On receiving a retui-n mes- 
sage, a tandem node allocates spare capacity on that 
span to the corresponding sourc6<lestination. 
[0044] Note here, also, that there may be several 
source node destination node pairs contending for 
spare capacities on a given span. In FIGURE 12. for 
example, the source node-destination node pairs. SI - 
D1 and .S2-D2. contend for spare capacity in span 46 



between ^ta/ulem nodes, T1 and T2. At the end of the 
explore phase the tandem nodes. T1 and T2. know 
exactly which source node-destination node pairs con- 
tend for spare capacity on that span 46., During the 
5 return phase tiie tandem nodes, T1 and T2, allocate 
capacity Ibr a source node-destination node pair based 
on a contention resolution rule. One such rule is to allO: 
catethe spare capacity evenly to the contending source 
node destination node pairs. Usinp this rule, tandem 
10 node, T1. allocates 25 units to the pair source' node- 
destination node, S1-D1.. and. 25 units to the source 
node destination node pair; S2-D2. on the span 46 
between tandem nodes, J1 and T2, ' 
[0045] Continuing further in the return phase, each 
15 tandem node, Tl and T2. appends its node identifier 
and the amount of spares allocated to "spare route info" 
field 102 of tiie return messagelOO and fbnwards it on 
the span .46 on which it received, the corresponding 
explore message 70 first The tandem node might have 
20 received explore messages 70 for the same source 
node-destination riode pair on other spans 46 too. On 
those spans 46 it sends a return message 100 'with 
"spare route info" field 102 containing only its node 
identifier.. 

25 [0046] ., In FIGURE 13. tandem node, T4. allocates 50 
uriits of.spare capacity on the span 94 between tandem 
"«^e,T4 ,^i?ql destination node D. lt appends tfie param- 
eter: value?- .j[T4.50) to the return message i 00 and 
sends return, message 100 to tandem nqde, Tl' Tan- 
30 dem node. T4. also sends a return message 1 00 to tan- 
dem -nocj^ - T2. since it also received an explore 
message from, tandem node T2. with "spare, route info" 
field 102 containing the parameter value, g4). 
[0047]. FIGURE 14 shows a last step of the retum 
35 phase. A squrce node.22 may receive a return message 
100 at any step during the return phase. The source 
node 22 can ,easily detect that it is the source node for 
the return message 100 by looking at the "source id" 
.field 74 of the return message 100., If the source node 
40 22js the source node for the return message ioo. the 
source node 22 first allocates the spare capacity for the 
message on the span on which the message amved 
, using the contention resolution rula 
[0048] The "spare route info" field 102 contains infor- 
45 mation about, a spare route from the source node to 
destination node and the amount of spare capacity 
available on the spans that make up the spare route. 
Based on all of the reft/r/? messages 100 received, tiie 
source node constructs a subnetwork with spare capac- 
50 ities. A source node 22 waits for the return phase to 
complete and proceed to the maxflow execution. Due to 
.synchronization, the source ..node knows when the 
return phase will be complete. 
[0049] At the end of the return phase, a source node 
55 22 would have constructed an alternate route within the 
network complete with spare capacities based on 'tfie 
return, messages it receives. .FIGURE 15. therefore, 
-shoyvs set 96 of alternate routes for distributing the ds- 
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rupted communications traffic. The source 'node 22 node; T4. The connect message 120 travels the chosen 

may. now that it holds altemiale rpute set 96 of possible alternate path and finally reaches its destination node, 

alternate paths; perform a maximum flow process' to D. 

maximize the amount of traffic that can be restored. [0055] With the preferred embodiment, there are two 

Examples of maximum; flow processes appear, in T H. s events that can terminate the network restoration proc- 

Gormen; et *al, "Iritroductidn to Algorithms" (The MIT ess at a node. First, the process will terminate once the 

Press.' 1990): and J.E. Baker, "Distributed Link Restora- last iteration completes. If all the paths were restored 

tioh with Robust Planning," Proc.. QLOBACOM 'S^ , pp. much before the last iteration, the process can be termi- 

306-311. Dec. 199V.) These publications iDuslratewa^ riated earty. except for the requirement of sending 

to determine ajl the disjoint paths with the maximurri w "alive" messages to the system. 

fiow between two disrupted nodds. Another efficient dis- [0056] Each source node 22 sends a path restored 

tributed maximum flow algorithm* Is described by QoId-= hiessage once it has restored all the failed paths. FIG- 

berg and Tarjan in "A New Approach to the Maximum- URE 19 provides the format for the path restored mes- 

Flow Problem," Jour. Assoc. Comp. Mach., yol.35, No. sage 130. The fields of path* restored message 130 

'4. pp.921 -940. Oct. 1988.-Wfth the present invention, a 'is include "msg type" field 72; '"source id" field 74; and 

wide variety of maximum flow processes- may be used "destinatiori id" field '76, all of which' have been. . 

to generate a maxirrujm traffic flow path. described above, the destination now being the- con- 

[0050] The distributed telecommunications network tents of these field designing the path restored message 

alternate paths that the present invention constructs as such. If a node receives path restored messages 

begin from' source node; S. following the completion of 20 from all the source node-destination node pairs for 

the return phase.' as'shown In FIGURE 15. Source node which It has received failure message 30, this properly 

S executes the results " of the maximunri flow determine- terminates the present method and system. ' 

tion process and the alternate routes discovered as [0057] Although the inverition has been described in 

appears In FIGURE 16. The alternate route of FIGURE detail herein with reference to the illustrative embodi- : 

16 restores 100' units of traffic. Using a maximum flow 25 meats, it is to be understood that this description is by 

proces^ 'iassures that the amount of traffic "^that the way of-example onlyand is not to be construed In a.lim- i ^ 

present invention restores in the alternaterStrte or sub- itingsehse. It is to be further understood, therefore, that - v 

network that 'thW'present irtverition generate^'-will be numerous changes in the details of the embodimente'of | 

maximurri possible tor the given hetwork'and traffic con- the invention arid additional embodiments of the inven- 

ditions. ' - ' ^ .^"^ ':v 30 tion will be appaT'entto and may be made by persons of 

?[0051 ] On the' oiHer hand, if a source node 22- has not ordihary skill in the art having reference to this descrip- 

restorfed traffic completely at the end of ifie maM'mum tion. It is cohiemptated that all such changes and addi- 1. 

flow process execution, the method of the present tionai embodimertts &re within the spirit and true scq^e % 

irtventiorl proceeds to a next heratibn. The method also of the invention as claimed below; ' ; " 

sends connkrt niessages to the other nodes to nriaKe 35 ' • ' . * / > 

the required cross connections. ■ Claims ' ' w 

[0052] At'the end of the maximum flow process, the ' ' 

present invention should have generated several alter- 1. • A method for restoring a distributed telecomnroni- 

' hate routes for communications traffic flow. As shown m cations network by re-routing traffic from one path 
FIGURE '16. firist an 'altemale route, S-T1-T4-D,-' with 40 to another when a link or a node in an original patii 
capacity 50 may be found. Next, another route. S-T2- fails, comprising the steps of: * 
T3-D, with capacity 50 may be found.' As and when an . ; 
alternate route is found a connect message Is created notifying nodes neighboring said failed link of 
and sent: ' ^ • ■ * ' the distributed telecommunications network of 
[0053] FIGURE 17 provides the format of connect 45 the failure of the link; 
message 1 10. The "msg type" field 72, "source id" field determining a plurality of altemate paths for re- 
74, and "destinatiori id"*f ield 76 function as described ^ routing the disrupted traffic by sending a plural- 
above. Tiie ^path id list" f ield 112 provides a list of jpath ity of messages throughout the distributed tele- 
identifiers that will be roiled to a particular alternate communications network; 
rdute. The "route info" field 1 14 contains the route infor- so issuing to- a conti-ol mechanism a plurality of 
mation for the particular aHernate path. • * connect commands for making cross connec- 
[0054] ' FiGU RE 1 8 'provides an example of the con- tions to nodes on selected ones of the alternate 
nect message 120 for tiie alternate route'. *SiTl-T4-D. paths; and 

with capacity of 50 units, for example. Source node, S. ^ . . synchronizing the nodes of the alternate paths 

sends the connect message 120 to the next node in the 55 • ' for connecting the nodes along the selected 

alternate route' which is * tandem node. T1. Tandem ones of the alternate paths. - 

node, T1; issues the command to make^ necessary ^ ' • 

cross connections and fonwards the message to tandem 2. The method of Claim 1 , wherein said notifying step 
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further comprises the step of sending at least one 
failure message to said neighboring nodes. 



3. The method of Claim 1. wherein said determining 
step further comprises the step of sending a plural- 
\Xy of explore messages, throughout said distributed 
telecommunications network for exploring possible 
. alternate paths for rerouting the disrupted traffic. 

The method of Claim 1 , wherein said determining 
step further conprises the step of sending a plural- 
ity of return messages throughout said distributed 
telecommunications network for reporting a possi- 
ble alternate path for rerouting the disrupted traffic. 

i. The method of Claim 1 . wherein said determining 
step further comprises the step of executing a max- 
imum flow process for determining at least maxi- 
mum flow alternate path through said distributed 
telecommunications network. 

■ The method of Claim 1. wherein said issuing step 
further comprises the step of issuing a plurality of 
connect commands, said connect commands com- 
prising data relating to source node and a destina- 
tion node together with data relating to a data path 
and a route of tandem nodes between said source 
node and said destination node. 

The method of Claim 1, wherein said synchronizing 
step further comprises the step of first generating at 
least one step completed message from at least a 
destination node followed by generating a restora- 
tion message and a step completed message from 
a source node. 

A distributed telecommunications network having 
the ability to restore a distributed telecommunica- 
tions network by rerouting traffic from one path to 
another when a link or a node in an original path 4o 
fails, said distributed telecommunications network 
comprising: 



.. .. traffic by sending a plurality of messages 
throughout the distributed telecommunica- 
tions network; - 

instructions for issuing to a control mecha- 
nism a plurality of connect commands for 
making cross connections to nodes on 
selected ones of the alternate paths; and 
instructions for synchronizing the nodes of 
the alternate paths for. connecting the, 
nodes along the selected ones of the alter- 
nate paths. ■ 

9. The distributed telecommunications, network of 
Claim 8. wherein said notifying insfructions further 
comprise instructions for sending at least one fail- 
ure message to said neighboring nodes. 

10. The distributed telecommunications network of 
Claim 8, wherein said determining, instructions fur- 
ther comprise the instructions fo? sending a plurality 
of explore messages throughout said distributed 
telecommunications .network for expWmg possible 
alternate paths for rerouting the disrupted traffic. 

25 11. The di^ributed telecommunications network of 
. Claim, 8, . wherein said determining instructions fur- 
thor G(^rise the instructions for sending a plurality 
■ of return messages throughout said distributed tel- 
ecommunications network for reporting a possible 
30 „ alterfiate^path for rerouting the disrupted traffic, 

12. Jhe .-distributed telecommunications network of 
Claim 8. wherein said determining instructions fur- 
ther conprise the instructions for executing a maxl- 
35 » mum jow process for. determining at least 
' . maximum flow alternate path through said distrib- 
;Uted telecommunications network/ 



IS 



20 



a plurality of nodes for routing telecommunica- 
tions traffic; 

a plurality of links for establishing a path con- 
necting selected ones of said plurality of nodes; 
said nodes comprising a set of network restor- 
ing instructions and circuitry for executing said 
network restoring instructions, said network 
restoring instructions comprising: 

instructions for notifying nodes neighbor- 
ing said failed link of the distributed tele- 
communications network of the failure of 
the link; 

instructions for determining a plurality of 
alternate paths for rerouting the disrupted 



.45 



50 



13. The distributed telecommunications network of 
Claim 8. wherein said issuing instructions further 
: comprise the instructions for issuing a, plurality of 
connect commands, said connect commands com- 
prising a data relating to source node and a desti- 
nation node together wHh data relating to a data 
path and a route of tandem nodes between said 
source node and said destination node. 



14 



55 



. The distributed telecommunijcations network of 
Claim 8. ;Wherein .said synchronizing , instructions 
further conprise the instructions for first generating 
at least one step completed message from at least 
a destination node followed by generating a resto- 
ration message and a step completed message 
from a source nod^. 



1 5. A method for forming a distributed telecommunica- 
tions-network having the ability to reroute traffic 
from one path to another when a link or a node in an 
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original path falls, said distributed telecommunica- - 
tlons network fornrring method comprising the steps 
of: 

" " forming a plurality of nodes for routing telecom- 
munications traffic; * 

forming a plurality of links' for establishing a 
path connecting selected ones of "said plurality 
of nodes; and • 

forming said plurality of nodes to comprise a 
set oi network restoring instructions and cir- 
cuitry tor executing said network restoring 
instructions, said network restoring instmctions 
• formed l>y the steps of: * " 

' forming iristructions for riotifyihg nodes 
neighboring said failed link of the distrib- 
' ' ' ijted telecommunications network off the 
' . failure of the link; 

^ forming instructions for determining a plu- 
' rality of alternate paths for re-routing the 
' dfisrupted traffic by sending a plurality of 
* ^ messages throughout the distributed tele- 
conimunications network; 
' ' forrhing instructions for Issuing to a control 

• ' mechanism a plurality of cdhnect com- 
mands for making cross connections to 
nodes on selected ones of 'the-alternate 
^ • paths; and ' ■ :' ■ 

forming instructibhs ior syrichrdhlzing the 
nodes of alternate path for connecting the 
nocies along the selected dh& of the alter- 
' . nate paths. ■* • '! 

16. The nriethod of Claim tS, wherein -said notifying 
instructions forming step further comprises the step 
of forming Instructions for sending at least one fail- 
ure message to said neighboring nodes. 
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35 



nications network. 

The method of Claim 15. wherein said issuing 
instructions forming step further comprises the step 
of forming instructions for issuing a plurality of con- 
nect commands, said connect commands compris- 
ing a data relating to source node and a destination 
node together with data relating to a data path and 
a route of tandem nodes between said source node 
- and said destination node. ' 



17^ The method of Claim 15, wherein said deterrriining 
' Instructions forming step further comprises the step 
of forming instructions for sending a plurality of 
explore messages throughout said distributed tele- 
communications network for exploring possible 
alternate paths for rerouting the disrupted traffic. 

18. The method of Claim 15. wherein said determining 
• instructions forming step further connprises the step 
' ' of forming instructions for sending a plurality off 

return messages throughout^ said' distributed tele- 
communications network for reporting a possible 
alternate path for rerouting the' disrupted-traffic. 

19. The method of Claim 15, wherein said determining 
instructions forming step further comprises the step 
of forming instructions for executing a' maximum 
flow process for determining at least maximum flow 
alterriate path through said distributed telecommu- 
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